…on` (vllm-project#9446)

…#9344)

…vllm-project#8704)

Removing the block manager v1. This is the initial piece of prefix-caching-centric design. In order to achieve prefix-caching-centric design, we need to simplify the code path so that we only use v2 block manager (which has much higher performance on prefix caching).

…llm-project#9375)

…t#9300)

…-project#9299)

…cript (vllm-project#9013)

Co-authored-by: Isotr0py <[email protected]>

…ce (vllm-project#9468)

…ary (vllm-project#9380)

…ect#9056)

Signed-off-by: Max de Bayser <[email protected]>
Signed-off-by: Max de Bayser <[email protected]>
Co-authored-by: Andrew Feldman <[email protected]>
Co-authored-by: afeldman-nm <[email protected]>
Co-authored-by: Woosuk Kwon <[email protected]>
Co-authored-by: laishzh <[email protected]>
Co-authored-by: Max de Bayser <[email protected]>
Co-authored-by: Max de Bayser <[email protected]>
Co-authored-by: Cyrus Leung <[email protected]>

…ject#9381)

…sage (vllm-project#9352)

Signed-off-by: Joe Runde <[email protected]>

…t#9430)

…roject#9473)

…t#9475)

Signed-off-by: Russell Bryant <[email protected]>

…ation and embedding (vllm-project#9424)

…oject#9036)

Co-authored-by: Kunjan Patel <kunjanp_google_com@vllm.us-central1-a.c.kunjanp-gke-dev-2.internal>

…ix.py (vllm-project#9510)

…r cores (vllm-project#9497)

Signed-off-by: Thomas Parnell <[email protected]>
Co-authored-by: Chih-Chieh Yang <[email protected]>
Co-authored-by: Cody Yu <[email protected]>

)

Signed-off-by: Joe Runde <[email protected]>

Signed-off-by: Gregory Shtrasberg <[email protected]>

Co-authored-by: Yang Zheng(SW)(Alex) <[email protected]>

Signed-off-by: daitran2k1 <[email protected]>

…ject#9974)

Signed-off-by: MengqingCao <[email protected]>

…-project#9915)

Signed-off-by: chaunceyjiang <[email protected]>

Signed-off-by: youkaichao <[email protected]>

Signed-off-by: Jee Jee Li <[email protected]>

Signed-off-by: mzusman <[email protected]>

Signed-off-by: Robert Shaw <[email protected]>

…nning parallel jobs (vllm-project#9279)

Signed-off-by: Hissu Hyvarinen <[email protected]>

Signed-off-by: Roger Wang <[email protected]>

Signed-off-by: [email protected] <[email protected]>

Signed-off-by: Linkun Chen <[email protected]>
Co-authored-by: Linkun Chen <[email protected]>
Co-authored-by: Linkun Chen <[email protected]>

Signed-off-by: Tomer Asida <[email protected]>

Signed-off-by: Bill Nell <[email protected]>

…0007)

Signed-off-by: youkaichao <[email protected]>

…ct#9895)

Signed-off-by: mgoin <[email protected]>

…m-project#9994)

Signed-off-by: Tyler Michael Smith <[email protected]>

…osable (vllm-project#9604)

Signed-off-by: DarkLight1337 <[email protected]>

Signed-off-by: Tyler Michael Smith <[email protected]>

…llm-project#10017)

Signed-off-by: chaunceyjiang <[email protected]>

…a/oct_28_rebase

…_28_rebase